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Abstract 

We discuss control of low-dimensional systems which, when uncontrolled, are integrable in the 
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uncontrolled dynamics has invariant tori. Both dissipative and conservative controllers are con- 
sidered. We show that the shear flow structure of the undriven system causes a Takens-Bogdanov 
birfurcation to occur when control is applied. This implies extreme noise sensitivity. We then 
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I. INTRODUCTION 



In the last several years there has been a lot of interest in improving the methods for the 
control of nonlinear physical systems. Due to the large variety of behaviors which nonlinear 
systems display, a single control theory which can be applied to all nonlinear systems will be 
very difficult (if not impossible) to develop. It seems likely that the best way to approach 
the control of nonlinear systems is to learn how to control classes of systems instead of 
trying to develop one single all-encompassing theory. For example, in [1] control of Euler- 
Lagrange systems, which encompass a very large class of nonlinear physical systems, are 
considered. Similarly, the work reported here restricts itself to a particular class of physical 
systems: those which are well modeled by integrable, or near-integrable, Hamiltonian dy- 
namical models. Finite dimensional examples of integrable systems are linear oscillators and 
certain systems of nonlinear oscillators. Examples in infinite dimensions includes soliton sys- 
tems such as the Korteweg-de Vries (KdV), nonlinear Schrodinger (NLS), and sine-Gordon 
equations. In particular we are interested in studying the interplay of dissipative and con- 
servative terms as a means to control integrable Hamiltonian systems. Toward this end, 
our strategy is to use a known exact solution as a target by turning it into an attractor, 
which cannnot exist in the original Hamiltonian dynamics. It is hoped that the knowledge 
gained from developing control laws for integrable Hamiltonian models that are simple to 
use, and robust to perturbations, will provide insights for developing control laws for real 
physical systems. The main result of this paper is that when a seemingly natural controller 
is applied to integrable Hamiltonian systems, a highly degenerate bifurcation known as a 
Takens-Bogdanov bifurcation occurs which severely limits the controllability of the system. 
As an example, the results described in Sections EJ- IIVI are then illustated on the nonlinear 
Schrodinger (NLS) equation. The NLS is integrable in the Hamiltonian sense and is a model 
system used to study phenomenon in plasmas and nonlinear optics and a variety of other 
fields. 

Here it is worth mentioning that Vaidya and Mezic have studied the controllability 
of a class of area-preserving twist maps. These twist maps are one-dimensional integrable 
Hamiltonian systems. They show that, under certain conditions, when a time- dependent 
controller is applied to the integrable twist-map global controllability can be attained for 
the system. In other words, the system can be controlled from any initial state to any final 
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state. Although their work deals with maps and not flows, this demonstrates that global 
controllability can arise when time- dependent controllers are applied to flows. 

The paper is organized as follows. In Section |H] we will begin with some general remarks 
on integrable Hamiltonian systems and present our control law of interest. In Section HTD we 
will study our control law when applied to an integrable Hamiltonian system with one degree 
of freedom. We will see that the degenerate shear flow dynamics inherent to an integrable 
Hamiltonian system will cause a Takens-Bogdanov bifurcation when control is applied. In 
Section |IV| we will discuss some aspects of the theory of Takens-Bogdanov bifurcations and 
their implications for robust control of the system. Section El contains a detailed example 
which uses a driven NLS to illustrate the results of Sections lllll and HV1 Finally, in Section lVIl 
we will conclude with some ideas for future work in the area. 



II. INTEGRABLE HAMILTONIAN SYSTEMS AND CONTROL 

Consider the following system of ordinary differential equations (ODEs): 

z = F(z), (1) 

where z, F G M. 2N and z are the "lab" coordinates, understood as the "natural" physi- 
cal coordinates. The system (0) is known as the "open- loop" (or undriven/uncontrolled) 
dynamics. 

In this paper, we specialize to F(z) = JVH where 

'-(::)• 

and the O's and l's are N x N zero and identity matrices and H(z) is the Hamiltonian, a 
scalar function of z. The system (JJJ is called integrable if there exists N first integrals of 

which are independent and in involution. If the level sets of the integrals are compact, 
then regions of the phase space are locally foliated by invariant manifolds with the topology 
of iV-tori In what follows, we assume (0) is an integrable Hamiltonian system and we 
study the control of (Q) on a typical (though arbitrary) invariant torus in its phase space. 

Consider a particular solution of ((TJ), z (t), which lies on one of those tori (z = F(z )). 
We now apply a controller which targets z (t): 

z = F(z) + e-f(z ,z), (3) 



where z (t) G M 27V and f is a 2iV-dimensional vector such that f(zo,Zo) = 0. The control 
coupling (gain), e, is a 2N x 2iV matrix whose entries need not be small. In principle, the 
control law f can also involve the past history of z(t) {i.e. 'feedback'). The equation (jSJ) 
will be called our "closed- loop" (or driven/controlled) dynamics. Note that the control is 
applied in the "physical coordinates", z(t). 

Our problem is: How do we choose f so that the given "target" orbit, zq, in the open- loop 
dynamics becomes an attractor in the closed-loop dynamics? By adding the controller, f , 
we are locally breaking up the tori and stabilizing one particular orbit. 

One choice for f is simply: 

z = F(z) +e- (z„(t) -z), (4) 

where e is the real 2N x 2N matrix, e = 6r1 + e/J, '1' is the 2N x 2N identity matrix, and 
(er, €i) are real constants with e# > 0. As we we'll show, this form of control can, for large 
enough €r, lead to synchronization of z to our target orbit, z [sj]. Notice, 

e 2 = (4-e?)l + 2 e/ e R J, (5) 

therefore (e#, ej) act like real and imaginary parts of a complex scalar gain under matrix 
multiplication of e. 

We can study the nature of the control law (J1J by performing a linear analysis about the 
target, z (t). Suppose z = z (t) + 5z(t) and insert this into our closed- loop dynamics (@J, 

6z = JS(t)6z - e R 5z, (6) 

where S(t) is a symmetric 2N x 2N matrix and involves the Hessian of the Hamiltonian 
evaluated on the target orbit z , 

d 2 H 

5 jfc(*) = dzjdzk' =Xo{t) ~ tl6jk ' ^ 
and Sjk is the 2N x 2A^ Kronecker delta function. In the case of e# | oo and e/ = 0, (JSJ) 
becomes 5z w —6r5z. This gives 5z(t) w e^ €fl '5z(0) which shows that in the limit of e/ = 
the control law in (J1J) is purely dissipative and z(£) — >■ z (£) on a timescale of 0(e/j _1 ). 

Now consider the case where en = 0. For short times (i.e. t — > t + h) S(t) can be 
considered as a constant matrix and (jUJ) integrates to, 

8z(t + h) =exp(hJS)5z(t). (8) 



It is known from the theory of Lie groups |2[ that the matrix M(t + h,t) = exp (hJS(t, e/)) 
is a symplectic matrix as long as S is symmetric, which it is by (JJJ). Hence, the control law 
in (0J) generates symplectic maps in the case of e# = (i.e. it generates time dependent 
canonical transformations). The orbits near z neither attract to z nor repel away from it 
and the controller is conservative. 

In Appendix El we show that in the neighborhood of zo(t) ® can be rewritten in terms 
of a new set of canonical variables, Z: 

Z = JV Z K(Z, t) - e R Z - e T JS (t)Z + 0(Z 2 ), (9) 

where So(t) is a symmetric matrix and K is a new Hamiltonian. In this paper we study the 
specific case in which So(t) is constant. The presence of non-constant So(t) complicates the 
analysis and is beyond the scope of this paper. As we will show, the presence of a constant 
So(t) is already a serious complication in terms of nonlinear analysis of the control law. In 
Section we will see that this simplification (of a constant So(t)) holds for the nonlinear 
Schrodinger equation. 

The goal of our work is to turn the target orbit z (t) into an attractor. We wish to 
understand the geometry of the attractor basin and the topology of nearby orbits. Doyon 
and Dube ^ demonstrate targeting periodic orbits of a particular period, m, in Hamiltonian 
systems when the location and the stability are unknown and the dynamics of the system are 
chaotic. Our work complements this result in that we will be studying the consequences of 
using both dissipative and conservative control for an integrable Hamiltonian system onto a 
known orbit. In addition, we focus on the local question of the closest 'distance' to the basin 
boundary of our new attractor. This distance strongly depends upon whether the control is 
conservative or dissipative. Note that there is no true meaning of 'distance' in phase space, 
hence by that term we mean the typical noise level which would destabilize the target. We 
will show that, due to the shear flow structure inherent to integrable Hamiltonian systems, 
something known as a "Takens-Bogdanov" bifurcation generically occurs when control is 
applied. As we will see, the appearance of a Takens-Bogdanov bifurcation implies that the 
evolution of the system will be very sensitive to noise and parameter uncertainty j^, 0] in 
the purely dissipative limit of (jlj. We will also see that by turning on the conservative part 
of the drive, ej, the controllability is improved. 

It should be pointed out that Haberman and Ho [?J have studied dissipatively perturbed 



Hamiltonian systems in a regime which contains two competing centers (which become 
attractors once the dissipation has been "turned on") separated by a saddle in the phase 
space before the perturbation is applied. Their Hamiltonian system is a nonlinear oscillator 
where the drive frequency is near (or at) the natural frequency of the system. Although the 
phase space topology they study is similar to ours, we are asking different questions. Their 
work is concerned with deriving an analytic form for the stable manifold of the saddle (basin 
boundary) using asymptotic methods (once small dissipation has been applied). The work 
presented here is concerned with the generic properties of both dissipative and conservative 
control laws applied to a general integrable Hamiltonian system. 



III. HAMILTONIAN SYSTEMS WITH ONE DEGREE OF FREEDOM 

Consider a Hamiltonian system with one degree of freedom and Hamiltonian H = H(q,p), 
with The evolution of p and q is dictated by the canonical equations: 

dH(p, q) 



dp 



P = (10) 

Suppose that for this system, the Hamiltonian has regions with compact level sets, implying 
there are regions of the phase space which are foliated by circles (1-tori) [2j]. These circles 
are invariant under the flow generated by H(p,q). On a given family of these tori, the 
coordinates (p, q) can be canonically transformed to the action-angle coordinates (/, <ft) and 
the Hamiltonian can be written as H(p, q) = H(I). The evolution of (I, 0) is of the form: 



0, 

dH(I) 



co(I). (11) 



dl 

In these coordinates the dynamics of (|llj) looks locally like a shear flow with each neighboring 
torus having a slightly different (constant) rotation rate (see Figure [TJ. The evolution of the 
action-angle variables is quite simple, making them the natural coordinates for this region of 
the phase space. It is important to keep in mind, however, that the evolution in the original 
(p, q) coordinates, although periodic, can be quite complicated. 

The system ()1U|). or equivalently will be our open- loop dynamics for control. The 
technique used to control (fTUj) is simple. First we must choose some target orbit of (fTUj) . 



(J O ,0 O ), where 

<po(t) =Uot + 5 (12) 

with 5 being an arbitrary angle between and 2tc and c^o = 9H(I)/dI\i . Without loss 
of generality, we will set 5 = 0. After choosing a target, we transform into a canonical 
coordinate system where the target is fixed at the origin, using a time dependent canonical 
transformation. This puts the target orbit at rest at the origin. We then turn on the con- 
troller which converts the origin into an attractor. We will find that applying the controller 



results in what is known as a Takens-Bogdanov bifurcation The presence of the Takens- 
Bogdanov bifurcation has an important effect on our ability to control the system to the 
target. Further, we'll see that as the control becomes more conservative (i.e. as ej/e R | oo), 
the controllability, as measured by the minimum 'kick' required to destabilize the target, is 
greatly improved even when e# 2 + e/ 2 is fixed. However, there is a tradeoff: while a large ej 
and small e# may produce a large basin of attraction it will also have a long decay time to 
the target. 

Let's choose our target to be: I = Iq and = <fio(t) with O defined as above. We 
perform the previously mentioned canonical coordinate transformation using the generating 



function |9| F 2 {I', 0, t) = (0 - w t)(I' + I ) with: 

K(I') = H(f + I ) + —^ = H(I' + J ) - (/' + JoVo- (13) 

Note that this transformation places the control target at the origin, (/', $) = (0, 0). 

Now we examine the dynamics about the origin via Taylor exapansion of the new Hamil- 
tonian, K(I') about the target: 



K(I') = H(I ) + w \ Io I' + - 2WI W 2 + ■ ■ ■ ~ (Jo + J>o. (14) 



Next, we ignore the constant terms, H(Iq) and ujqIq, and collect terms of 0(I' 3 ) and higher 
into a function h(I'), 

K(I') = -I' 2 + h(I'). (15) 
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(16) 



This Hamiltonian gives the following equations of motion, 

where /(/') = dh/dV is 0(7 /2 ). The equation (JToJ) is our open-loop dynamics and describes 
a shear flow with the entire I' = line fixed. Figure ^ shows the flow field of the dynamics 
of and (fTB^) . Such shear flow dynamics, characterized by a degenerate linear term, are 
the setting for a Takens-Bogdanov bifurcation jf]]. 

r 
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FIG. 1: Figure ^\ shows the flow field of the open- loop dynamics of Figure ^3 shows the 

flow field of the open- loop dynamics of the transformed coordinate system (jlfijl . Notice that the 
linear part of ()16|) has only one eigenvector which lies along the line of stagnation (/' = 0). 

Next, we examine the closed-loop dynamics. Recall equation 

z = F(z) + (e fl l + e/J)(z (t)-z), 

with F(z) = JVH(z) and z (t) is a solution to the open-loop dynamics (e# = ej = 0). 
While the second term of the RHS of (@J) is linear in the "physical coordinates" z = (p, q) 
it will, in general, contain nonlinear terms in z = (/', $) due to the nonlinear nature of the 
transformation from (p, q) to (/',$). Using and the results from Appendix 1X1 we can 
always write the dynamics in the following form (possibly after a near identity canonical 
transformation on (/', $)): 

MfM + f^)V (17) 
\I' ) \-m -en )\r) \f2(I',^e) J 
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where the e notation in f\ refers to both €r and £/. The minus sign in front of the e/ 
term ensures that a center opens up at the target (when the product Xr/ei > 0), as will be 
discussed below, and: 

h(?,fr,e) = /(O + e/iCi^je), 

/ 2 (/',<t>;e) = ef 2 (l',^,e). (18) 

The general solution to the linear dynamics of (|17j) is: 

$ W \ = e -e R t ( cos(v^7t) ^ sin(v^7t) \ ( $(0) \ 
J C \ -y/^sin(VWit) cos(v^7t) )\r(o))' 
Hence, we can see that the system undergoes a decaying oscillation which will eventually 
settle onto the target (origin) with a decay time scale of 0(1/ €r) and oscillation period 

O(Vv^)- 

The nonlinear behavior of systems with linear degeneracy can be subtle. To develop an 
idea of how each term in the closed-loop dynamics (purely dissipative and conservative) 
behaves, we consider two limits: i) €r ^ 0, ej = 0, and ii) ei ^ 0, €r = 0. We first treat 
their linear behavior. 

In Case i) (JU) becomes, 

z = F(z) + e R (z (t) -z), 

which is a purely dissipative drive, therefore we expect both linear and nonlinear dissipa- 
tive terms in (/', $) coordinates. In action-angle coordinates the dynamics becomes (see 
Appendix lA"j). 

*W~ fR A V*W /i(/ '*' £k) 1 po) 

P ) \ o - tR ) \i> ) \h(r,t,€ R ) ) 

In general, f\ and f 2 will be nonlinear functions in I 1 and $ and contains both linear and 
nonlinear terms in €r. It is clear that the linearized dynamics of (|2T)|) is non-diagonalizable 
even though linearly stable. A Takens-Bogdanov bifurcation can occur and, as we will see 
in Section IIVI will limit our ability to control (fTU|) to our desired state. In Section IIVI we 
will also discuss the effect of breaking the degeneracy in the diagonal term of (j2*U|) . 
The solution for the linear dynamics of (J2*U|) is: 




~ eRt Xte- €Rt 
e~ eRt 




(21) 



Where the texp(— e^t) term represents an effect known as transient amplification which will 
be described in Section IIVI After the transient amplification, we see exponential decay to 
the target on a time scale of l/e#. 
In Case ii) (@J) becomes, 

z = F(z) + e 7 J-(z (t)-z), 

which in Section |H] was shown to be a conservative drive. When the drive is periodic and 
resonant, we expect islands to open in the phase space centered around our target orbit. It 
is well known (see Appendix |B} that the width of those islands will generically be of 0(y/ej). 
Figure El illustrates this. 

i n 1 1 1 1 1 n 




FIG. 2: The island opening around the target at the origin is due to the presence of a conservative 
controller in resonance with the target solution (the origin). Here ei = 0.4 and r\ = 1. Notice the 
large width of the island, A = 0(^/eJ). 

When e R = (the purely conservative case), the equation (|T7|) becomes: 

P ) [-vet o) \r ) + [ur^^j) 

where rj is constant, and f\ are nonlinear functions of (/',$), and in geneneral, contain 
linear and nonlinear terms in ej and will be zero at the origin (note that the f^s will be 
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different than those in (JT7j) and (|20))). Because we have applied a conservative controller to 
our system, the closed-loop dynamics (j22j) is also a Hamiltonian system; therefore areas in 
the phase space are conserved, and no attractors can be present. In terms of control, this 
means that if the system is in an initial state which is inside the island, then the trajectory 
"orbits" the target but never settles onto it. Some dissipation must be present in order for 
control to be achieved. 

Setting €r = in (fHJj) the linear term of (|2"2"j) can be solved to give, 

/ $(t) \ I cos(VA^7*) ^sm(^Mj^t) \ ( $(0) 
\I\t)J ^_yy sin (VA^7t) cos(v^7t) ) \I'(0) 

Hence, we see that the trajectories orbit the target with frequency y/Xrfei and never settle 
on to it. Further, the \J~-^ term in the off-diagonal entries of (f23J) show that the island 
which is formed is very thin. This can be seen by following an orbit which starts at (I'(0) = 
0,$(0) = A$). The orbit, centered about the origin, is elliptical and will intersect the I' 
axis when t — t\ — 2y /\ mi ( one 1 uar ^ er °f the period). We can see from ()23|) . that the orbit 
intersects the I 1 axis at (/' = —^^A^, $ = 0), hence the island is very thin (0( Ak /e7)) 
compared to the initial A$ displacement. However, this island will 'open up' rapidly as e/ 
is increased. 

In the next section, we will show that the presence of the ej terms in the linearized 
dynamics enlarges the basin of attraction associated with the Takens-Bogdanov bifurcation 
and thus improves the control. In Section IS we will give an explicit example of this result 
using a driven NLS equation. 




IV. TAKENS-BOGDANOV BIFURCATIONS 



In Section |nTJ we showed that, in general, the linearized dynamics of an integrable Hamil- 
tonian system becomes non-diagonalizable in the limit of no control (en j and ti — > 0). 
When a system's linearized dynamics becomes non-diagonalizable, a Takens-Bogdanov bi- 



furcation occurs. The interested reader is directed to the most recent edition of [TJ| for 
a thorough discussion of Takens-Bogdanov bifurcations and P, |(| for a discussion of es- 
timating the distance to the basin boundary in the subcritical case, and aspects of noise 
driven escape in the purely dissipative case. We do not consider the full 'unfolding' of the 
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Takens-Bogdanov bifurcation, but only those parameter ranges relevant to the present con- 
trol problem (i.e. those having a basin of attraction). In particular, we study the unfolding 
using the natural parameterization inherited from of our control law rather than that of 
jll | (note that we keep the target fixed at the origin, while the standard parameterization 
moves it). In this section, we will present the information most relevant for our work here 
as well as expand upon the results of 0, |(| to include the conservative term. 

We begin by considering the purely dissipative case, e/ = 0. We will use (}2Tjj) as our generic 
example of a system exhibiting a Takens-Bogdanov birfurcation. For the situation of interest 
here, the Takens-Bogdanov bifurcation involves a degenerate saddle-node bifurcation in ()2()|) 
when €r I 0. The degenerate node at the origin will be the solution of (JTUJ) which is the 
target for control. 

When €r = (Figure we have a line of neutral stability which bounds two shear flow 
regions (/' > 0, and I' < 0). When e# becomes greater than zero (Figure a stable node 
appears, denoted O. The effect of the previous shear flow can still be seen, however, as the 




FIG. 3: A qualitative sketch of the dynamics when e/j > 0. The node is denoted by the point, 
O. The nonlinear terms have not yet been added. The effect of "transient amplification" is clearly 
present. The horizontal line is the old line of neutral stability which separated the two shear flow 
regions. 

trajectories must approach the node tangentially along the old neutrally stable line with very 
slow transverse dynamics. The further a trajectory starts away from the node the greater the 
effect of the shear flow which forces the trajectory to travel further in the horizontal direction 
before being attracted to the node. This effect is known as "transient amplification" since 
the distance to the node will typically grow, before the slow decay to the node sets in. If the 
diagonal terms of (f2TJj) are slighly different (em ^ e^), Figure El changes slightly because the 
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exact degeneracy of the eigenvectors is lifted. However, transient amplification still occurs 
since it is due to the linear term being ill-conditioned a, 



Provided certain conditions are met (described in [6]) a saddle-point appears in the neigh- 
borhood of the node. In Figure EJ we zoom in on the area around the node with e# > 
and we include the nonlinear terms fi and f2- One half of the line of neutral stability be- 
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13lQ. 




FIG. 4: Illustration of the "triangle relation" of 6]. The shortest distance to the basin boundary, 
cr c , is now along some other direction in the phase space besides the saddle-sink connection. 



comes one half of the unstable manifold (W u ) for the saddle point, sometimes called the 
saddle-sink connection. This piece of the unstable manifold ends at the degenerate node, 
O. The other piece of the unstable manifold (W u ) can lead to another attractor of some 
type (not shown). In Figure we show the full basin of attraction for the node, O. The 



v 
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FIG. 5: A typical basin of attraction for a node undergoing a Takens-Bogdanov bifurcation. Notice 
the distinctive tear drop shape of the basin due to the near-degeneracy of W s and W u . 

saddle point, S, also has a stable manifold (W s ) which forms the boundary of the basin of 
attraction for O. Extending W s typically gives a tear-drop shaped basin near O which is 
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one hallmark of a Takens-Bogdanov bifurcation. Some sample trajectories are included in 
Figure El and labeled, Tj. Notice that while one of the trajectories, T\, is attracted directly 
into the node, the other trajectory, T 2 , misses the node on its first approach and must travel 
in the vicinty of W s before connecting to the node. There is only one direction in which a 
trajectory may approach the node, along the saddle-sink connection. The tear-drop shape 
for the basin comes about because, as €r j 0, the eigenvectors of the linear dynamics in the 
vicinity of the saddle become degenerate (parallel) and, therefore, the angle between the 
stable and unstable manifold of S decreases. The near-degeneracy of W u and W s can be 
seen in Figure 0D 

Due to the shape of the basin of attraction, systems exhibiting a Takens-Bogdanov bi- 
furcation are extremely sensitive to noise and parameter uncertainty |5|, and the subcritical 
threshold of instability (i.e. the distance to the basin boundary) scales differently from 

rt fi n 

normal saddle-node and Hopf bifurcations 6]. Both 5( and p demonstrate that the dis- 
tance to the basin boundary, a c , is proportional to e^ 1 (7 > 1), where 7 can be computed 
using a simple formula once the normal form of the dynamics in the neighborhood of the 
target is found. A normal form analysis simplifies the dynamical system near the target 
using near-identity transformations. The normal form reveals which nonlinear terms govern 
the topology of the phase space near the target (e.g. the location of the basin boundary 
of the target) and, for e# 3> ei (see below), gives the location of the saddle, S. In some 
applications, noise may be applied randomly in the phase space, and therefore a c also gives 
a noise threshold for instability. However, when e# \ and ej 7^ 0, the normal form can give 
misleading results, as will be shown. 

We consider the case in which the controller contains both dissipative and conservative 
terms. Our goal is to derive a subcritical threshold scaling, cx c (e#, ej). We will use a method 
similar to that in [f| . Following our results from Section IIII[ the normal form of our model 
system to leading order in the vicinity of the control target is: 



(24) 



where we have chosen Xrjei > and bi, 62 are constants. The open-loop (e^ = ej = 0) form 
of (J2~4*j) is sometimes known as the Bogdanov form (TJj . The nonlinear terms are the generic 
dominant terms for a Takens-Bogdanov system [f| , found by casting the open-loop dynamics 
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of A17J1 i n to normal form. We now describe how to estimate o~ c using the triangle relation 
of fl. 

First, find the location of the saddle by setting $ = / = and solving: 

= 4 + AT?e 7 (e| + Ar/ej)e R 

5 (M + e^)' 5 (Afer + e^A" 1 ° J 

As in 0, we see that the $ 2 term is dominant if Xb± and 62 are 0(1). It is important to 
note, however, that when e R : = and e/ 7^ 0, the dynamics of ()24|) are diagonalizable and 
not degenerate. In this case, the normal form is suspect because we need to include higher 
order terms so that we may correctly describe the location of the saddle and the shape of 
W s . In what follows, we assume ej <C 

Second, linearize (f2"^l about the saddle point ($ = <3>s + u, I — Is + v): 







[i) 





-cr A 

2 -^ + m -e R 




(26) 



The eigenvalues of the linear dynamics are: — e# ± ^/2en 2 + Xrjei. This verifies that the 
second fixed point is indeed a saddle-point (recall, we fix r/ej > 0), for A > 0. 

Third, find the angle between W s and W u in Figure EJ which we denote, 9. This is done 
by finding the eigenvectors of the linear dynamics of ()26|) and using the cosine relation for 
the dot product of the two vectors. It can be shown that: 

V2 



d = ^- x l2el + \ m . (27) 



Finally, the triangle relation from Figure 0] 6] provides the estimate: 

. n V2 e 2 R + X V ej 



R Z />,/Cj /0.2 



2e 2 R + Xriej, (28) 



A (hX + SRh) 

where ej 6r. For discussion of the higher order corrections to (|2~%j) . see Appendix O 
As demonstarted in Appendix the largest source of error in the triangle relation comes 
from not including the curvature of the stable manifold in ()28|) . The triangle relation is the 
first order term in a Taylor series approximation of the stable manifold. In Appendix El 
we estimate the error in (|2"%|) by including the next higher order terms in the Taylor series 
approximation. We see from (|2"£j) that in the purely dissipative case, e/ = 0, a c ~ e^ 3 , and 
we recover the result from |.6J. Hence, (J28|) shows that the presence of a conservative term 
in the control law increases o c . This is sketched in Figure O Notice that in Figure that 
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FIG. 6: A qualitative sketch of a typical basin of attraction for a node in a Takens-Bogdanov 
system with a conservative term present. Notice how much larger the basin is here, as compared 
to Figure |S] and note also the target point is now a stable spiral. 

a c has dramatically increased as compared to Figure El and now, the node has become a 
degenerate spiral as demonstrated in (JTHJ). 

In Section^ we will apply the results from this section and Section UTTl to a simple control 
scheme for a driven Nonlinear Schrodinger Equation. 



V. CONTROL OF THE NONLINEAR SCHRODINGER EQUATION 

The one dimensional focusing nonlinear Schrodinger Equation (NLS), 

iq t + q xx + 2\q\ 2 q = 0, (29) 

governs the envelope dynamics of waves that, to leading order, are weakly nonlinear, nearly 
monochromatic, and dispersive. Here, we consider solutions of (|2*9*|) that are periodic in 
space (i.e. q(x,t) = q(x + L,t) for some box size, L, and we choose L = 1). The NLS 
is used as a model system in many areas of physics such as plasmas, water waves, and 
nonlinear optics. The interested reader is referred to which contains many references for 
applications of the NLS in its introduction and develops a special class of exact solutions to 
the NLS, specifically those associated with modulational instabilities. Ultimately, we wish 
to use this special class of solutions to design control laws for NLS-type systems such as 
the Ginzburg-Landau equation [l^ and Dysthe's equation [3]. The Ginzburg-Landau and 
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Dysthe equations are not integrable, but NLS appears as a limiting case. It is hoped that the 
current work described here will provide insights in developing control laws for these non- 
integrable systems as well. Such control laws, for example, might be designed to suppress 
instabilites or to exploit them for pulse formation. That work will be reported elsewhere. 
In what follows (J29|) will be our open-loop dynamics. 

The NLS is an integrable Hamiltonian system with Hamiltonian, 

h= f (Igl 4 -!^! 2 )^. (30) 

J o 

where q* is the complex conjugate of q(x, t). We restrict our attention to q, q* that are C°°. 
We consider the set of all such functions to be our 'phase space' with (q, q*) as dynamical 
variables on that space. The phase space variable, q, can be written as, 

oo 

q(x,t) = a n (t) exp(2%inx/ L), (31) 

71= — OO 

thus each e 2mnx ^ L define a 'basis direction' in the phase space, which is infinite-dimensional 
and has embedded within it invariant iV-tori. The G-function solutions of j3| give explicit 
representations of the dynamics on the iV-tori. In what follows, we will be interested only 
in q (x,t) = aexp(2za 2 t), thus restricting ourselves to targets that lie on a 1-dimensional 
invariant torus. This allows a very complete analysis and shows that this control problem 
is exactly of the form discussed in Section UTTl 



A. The Control Law 

Our goal is to control (j2El) to some target qo(x,t) which is an exact solution to We 
proceed as we did above by choosing our closed-loop dynamics to be: 

iqt + Qxx + 2|<?| 2 <? = i{e R + iei)(q - q), (32) 

Note that the presence of the i in front of the control law keeps €r the dissipative part of 
the control and ej the conservative part as was our convention in Section |HJ This control 
law is the same as (jlj). We choose ti < so that the target, go, is at the center of the island 
in the conservative limit (e# = 0) as discussed in Section ITTT1 

1 nas 



Equation ()32|) is a particular example of a driven nonlinear Schrodinger equation and 
been studied extensively by Li, McLaughlin et al. Q, Haller Q, and by Li and Wiggins 



21] 
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in the case of ej = 0. This body of work has revealed the rich geometrical structure that 
exists in the solution space of the driven NLS. These authors have extended the finite 
dimensional methods of invariant manifolds, Melnikov theory, homoclinic tangles, etc. to 
the infinite-dimensional solution space of this nonlinear PDE. We, however, will ask different 
questions. As stated earlier, our ultimate interest is to learn how to control physical systems 
for which NLS-type dynamics are reasonable models. We will exploit the integrability of the 
open-loop dynamics to gain insight into geometrical aspects of the control problem. The 
previously mentioned authors found that complex behavior exists throughout the NLS's 
solution space. Our goal is to suppress this behavior in the neighborhood of certain target 
solutions. 

We consider 'plane wave', i.e. spatially uniform, solutions of (J29|) hence, q xx = 0. Fix 
go to be qo(t) = aexp(2ia 2 (t — to)) where a is some real positive constant. For simplicity, 
we will choose to = 0. Hence, we first restrict ourselves to the invariant manifold of plane 
waves, denoted as Il c in Q|. Note that Il c is an invariant manifold of the closed- loop (|32|) 
dynamics because go G Il c , therefore, if q(t = 0) is a plane wave, then it will remain so. In 
what follows, we will assume q(t = 0) € IL. 

n 

We ask under what conditions does q — > q ? We will find, as is demonstrated in [19|, 
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2l|, that two attracting solutions can exist on Il c . For e# ^> a 2 (ej = 0), however, the 



whole complex plane attracts to the node. We will also show that the open-loop dynamics 
of ()29)1 are that of a shear flow and therefore a Takens-Bogdanov bifurcation occurs at the 
target qo when the control is applied. As discussed in Section HV] the presence of the Takens- 
Bogdanov bifurcation means that as { 0, the target has a small basin of attraction in 
the purely dissipative case (ej = 0). Thus, only a small amount of noise (<j c ~ O(e^), see 
below) causes loss of control of the system when a purely dissipative control law is applied. 
Once control is lost, the system settles onto the other attractor, which is a plane wave of 
much smaller amplitude. In Section ITTT1 we explained that the presence of the conservative 
term, e/, will cause the basin of attraction for go to increase in size, hence, increasing the 
controllability of the system. In what follows we will demonstrate that effect as well. We 
will finish our analysis in Section IVII with a brief discussion of control of NLS to spatially 
non-uniform targets. This is still work in progress and will be treated in a separate paper. 
Before we move on, it is worth mentioning that Friedland has shown that the NLS can 



be autoresonantly excited 



22, 231 and controlled. Autoresonance occurs when a nonlinear 
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oscillating system phase locks to a small amplitude oscillating drive with a slow frequency 
chirp. Autoresonance results in self-consistent control of the amplitude of the system as 
the drive frequency changes because the driven system changes its state in space and/or 
time in order to phase lock to the drive. For systems like NLS, where the frequency is 
a function of amplitude, this means that phase locking can be used to manipulate the 
amplitude without feedback and using a small gain (coupling), e. In (22)], Friedland and 
Shagalov demonstrate that the plane wave state of the NLS can be autoresonantly excited, 
and that as the amplitude reaches a certain threshold, a spatially modulated form arises 
and eventually becomes a shape not unlike a soliton. In |23j, Friedland extends his work 
to standing waves, and more recently with Shagalov j^J has shown how to excite multi- 



phase so 
done in 



utions of the Korteweg-de Vries (KdV) equation. Our work complements that 



23, 



241 ]: their work deals with a drive with fixed gain and a frequency chirp, 



ours has a drive with a fixed 'target' (no chirp) and we consider the size of the basin of 
attraction. 



B. Analysis 

Restricting ourselves to plane waves and using q (t) = aexp(2ia 2 t) as our control target, 
(j3~2~j) becomes: 

iq t + 2\q\ 2 q = i{er + iei)(aexp(2ia 2 t) — q). (33) 

We begin our analysis by writing q(x,t) in the form, q(t) = p(t)e l9 ^ (where p and 6 are 
real functions of time) and subsituting it into (|2*9*Jl to study the open-loop dynamics. Upon 
substitution into (|2*9*jl we get, 

p = Q, 

6 = 2p 2 . (34) 

As shown in Figure ()34j) describes a shear flow as expected from Section ILTTl We can 
also transform into coordinates rotating with the target (the bold circle in Figure 0A.) of the 
closed- loop dynamics by setting tp(t) = 2a 2 t — 6(t) and looking at the p — ip dynamics as 
shown in Figure [7f3 where ip = 2(a 2 — p 2 ). Thus relating the dynamics of NLS to (|16J). 

Next, we analyze the closed-loop dynamics by inserting our ansatz, q(t) = p{t)e ld ^\ into 
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FIG. 7: The dynamics for (|34|) when cr = ei = are shown in Figure [TJ^, note that this is a shear 
flow. The bold circular orbit has \q\ = a. Figure 03 shows the dynamics of ()34j) transformed into 
coordinates rotating with the target. Notice that Figure [7p is a shear flow with a fixed circle of 
netural stability. 

(J33J) to get, 

p = en(a cos(t/>) — p) — t\a sin^), 

i) = 2(a 2 -p 2 )-^ sin(V>) - -(a cos(^) - p). (35) 



Figure |H1 illustrates the state space of (|33|) . The variables are the real (x = pcos(?/>)) 
and imaginary (y = psin(ifj)) parts of q with e/ = and e# = 0.4. The tear drop shaped 
basin of attraction, B, for the target, O, is clearly present and is characteristic of the 
Takens-Bogdanov bifurcation. Notice how small B is locally, even though the strength of 
the dissipation is quite high (e# = 0.4). Physically, this tells us that only a small region of 
"nearby" states are controllable to our target. Worse yet, there is a small noise threshold for 
instability. This can be quantified by measuring the shortest distance, u c (^r), between the 
basin boundary , W s , and the target, O, in the negative x-direction. The point in Figure |H1 
denoted 5* is a saddle point whose location will play a crucial role in computing a c as was 
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Re(q) 



FIG. 8: The state space diagram for with a = 1, ej = 0, and 6r = 0.4. The variables are 
x = Re(q) and y = Im{q). Notice how the stable manifold (W s ) of the saddle (S) creates the tear 
drop shaped basin of attraction, B, for the target, O. The unstable manifold of the saddle (S) is 
denoted by W u . The large value of e# was chosen to accentuate the features of the basin. 

shown in Section ITVl The unstable manifold of the saddle, S, is denoted W u . The point, Q, 
is a stable spiral and is associated with a small amplitude plane wave. 

In Section ITTT1 we stated that the presence of the conservative term in the controller (ej) 
will enlarge the basin, B. Figure |H1 illustrates this effect. Figure El shows the state space of 
f!33|) with 6r = 0.4 and ej = —0.1. Notice how much larger B is in Figure El as compared to 
Figure |H1 The labels in Figure 01 denote the same points and manifolds as in Figure |H1 It is 
interesting to note that the conservative term need not be large in order for its effect on a c 
to be noticeable. 

As is implied in Section IIII[ the most useful set of coordinates will be the action-angle 
coordinates. The action can be found using (q*,q) as our dynamical variables, (pjl) , and 
integrating pdq around one cycle (noting that the period, T = 2tt/uj = vr/p 2 ) j^laS], 

> = tJ^ = tJ^ = hi C q ' 2AqUit = " 2 - (36) 

We can then rewrite q(t) in terms of action-angle coordinates (/, <fi) by q(t) = vTexp(i0) 
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Re(q) 



FIG. 9: The state space diagram for ()33j) with a = 1, ej = —0.1, and cr = 0.4. Notice that the 
tear drop shaped basin of attraction is still present, but is larger than in Figure |H1 Even though ej 
is small compared to €r, its effect is quite noticeable. 

with the target action, Iq = a 2 . Using (JBTjj) we can re- write the Hamiltonian, 

H(I) = \q\ 4 = I\ 

4> = 21. (37) 

In Section IIII[ we transformed our angle coordinate into a new coordinate rotating with 
the target angle using a generating function, F 2 (I',(f),t). Recall that this transformation 
does not change the action coordinate. Following similar arugments presented in Section ITTT1 
we find, 

F 2 = (</>-2/ i)(/' + / ), 

i = r + 1 , 

K{I) = H(I' + I )-2I (I + I'), 

$ = <j)-2I t. (38) 

This transformation is equivalent to substituting q(t) = w(t) exp(2ia 2 t) into (JHHJ), 

iw t — 2a 2 w + 2\w\ 2 w = i(eR + iej)(a — w). (39) 



We can write w{t) in terms of action-angle coordinates w(t) = vJ'exp(i$), substitute this 
into(|39|) and expand about the target, I' = a 2 + y and $ = + x to get, 





H 


\yj 






)i 




H 
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e R I \ V I \ -£Ra 2 x 2 - j^y 2 + eixy 



(40) 



note that (x, y) are now linearization variables and not the variables from Figure |H| Further, 
note that from Section IIVI we know that the x 2 term in the y equation is the dominant 
nonlinearity. After performing a near-identity transformation, the normal form of (J4(Jj) is: 









-e R a 2 x 2 



+ .... (41) 



Note, the near-identity transformation does not effect the leading order (in terms of e R and 
6j) nonlinear terms. Further, we notice that in order for an island to open around the 
target, ej must be negative because r\ = 2a 2 > 0. From now on, we insert the negative sign 
explicitly. In this case, the bifurcation is exactly as discussed in Section IIVI 
Next, we find the position of the saddle: 

ei? 2 + 4a 2 e/ e fl 2 + 4a 2 e 7 

2a 2 e R 4cr 



(43) 



and we enforce, ej <C e R , for the reason discussed previously. Following Section IIVI the 
next step is to find the dynamics of ()41|) linearized about the saddle with x = xs + u and , 

y = ys + v, 

/ X / -e R 2 
e R 2 + 2a 2 e I -e R 

Next, we find the angle, 9, between the eigenvectors of (}4*3*|) . Using the formula for 6 from 
Section HV| we find that: 

hence, using the triangle relation we find: 









\ " 1 



«T C «M| = - 2q2 ^ y / 2e| + 4a 2 e J , (45) 

where e/ < e^. The higher order corrections are developed in Appendix O We see that the 
basin boundary in the purely dissipative case is only a distance of 0(e R ) away (because for 
NLS b\ = —a 2 e R ). In standard saddle-node bifurcations, a c scales like 0(e R ). In Figure ITUl 
we compare the results for finding a c using the triangle method with the results from an 
approximation of the stable manifold using higher order terms in the Taylor series expansion 
(see Appendix O for more details) for the purely dissipative case. Figure [TU] plots the 
difference between the numerical value of a c and the value estimated by each of the two 
methods. The numerical value of a c is found by computing where the stable manifold 
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A triangle relation 

■ manifold approximation 



-5.5 -5 -4.5 -4 -3.5 -3 -2.5 -2 

In(epsilonR) 



FIG. 10: Relative error in predicting a c . The triangles denote the error using the first order Taylor 
(i.e. triangle relation) approximation of a c and the squares denote the error using the second order 
Taylor approximation of <r c . Here, relative error means the magnitude of the difference between 
the numerical result of a c and the a c predicted by the two methods of approximation. 

intersects the x-axis of the state space (similar to Figure [SJ). It is important to note that 
the equations integrated for Figure ITU1 are not (jjOj), but rather the equations of motion for 
the real and imaginary parts of (JHHj) . For more details on this, please consult Appendix [DJ 
Figure EH shows that the error in both methods converges to zero, however, the manifold 
approximation method does so much more quickly. Even though the normal form analysis 
is performed in the limit er — > and, hence, the predictions are only valid in this limit, 
Figure Uni shows the purely dissipative scaling of a c ~ e 2 R) predicted by the triangle relation, 
is good for a large range of e^'s. 



VI. CONCLUSIONS 



We have shown that when attempting to control an integrable Hamiltonian system to one 
of its exact solutions a succesful control law will contain both dissipative and conservative 
terms. One source of the difficulty for control is the degenerate shear flow structure inher- 
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ent to these systems. The shear flow sets up a Takens-Bogdanov bifurcation which leads 
to the small basin of attraction for the control target. The presence of the conservative 
term enlarges the basin and therefore improves the controllability of the system. Successful 
control laws for integrable Hamiltonian systems are ones which are more conservative than 
dissipative, but dissipative terms must be present in order for the system to settle onto the 
control target and must be strong enough to allow for a relatively short decay time. 

Selection of the NLS to illustrate our results was more than a choice of convenience. We 
plan to use the insights gained in controlling NLS to develop control laws for non-integrable 
systems related to NLS: the previously mentioned Ginzburg-Landau and Dysthe's equation 
serve as examples of such systems. These NLS-like systems contain physical phenomenon 
which destroys the integrability. Such control laws may suppress or excite pulse formation 
in the system, for example. We have had success in controlling both Ginzburg-Landau and 
Dysthe's equation to NLS targets, therefore we know that studying integrable Hamiltonian 
models has relevance to the development of control laws for non-integrable systems. These 
targets are spatially non-uniform and are the ^-function solutions from This work is 
still incomplete and will be presented elsewhere. The high dimensionality of these systems 
makes detailed analysis difficult and led to our thorough study of the plane wave presented 
here. 

Future work in this area could include studying the control of integrable Hamiltonian 
systems with N degrees of freedom (2iV-dimensional). The behavior of higher dimensional 
systems has the potential to be much more complex than the case studied in this paper. To 
illustrate this, consider a 2iV-dimenional integrable Hamiltonian system with Hamiltonian, 
H{T), where I G M. N . As in Section HTH we transform to a coordinate system which fixes 
some target solution, (Iq, 4>o), at the origin. The Hamiltonian now becomes: 



where: we have ignored the constant terms, h contains terms of 0(I /3 ) and higher, and the 
N x N matric, C, is the Hessian: 



. Because C is a real symmetric matrix, we can diagonalize it with a similarity transformation 



K(l') = -l'.C-l' + h(l'), 



(46) 




d 2 H 



(47) 



dl'jdl'k 
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using a rotation matrix, R. This leads to the new system: 

1 



K'(A) 
D 

A k 
k 



-A-D- A + /i'(A), 
diag(Xi, A 2 , . . . , A at), 
0, 

OK' (A) 

dA k ' 



where k — 1, . . . , N, (A, 0) are the new coordinates, and Ai, . . 
C . Afer re-ordering the basis, the new equations of motion are: 

f&A 

e 2 o o o a 2 o 
h 



\A N j 



\ 




(eA 







A, 







e 2 







h 



On 
\A N J 



(48) 

Xn are the eigenvalues of 

/ gi(A) \ 
o 

, (49) 



^tv(A) 




/ 



■■• X N 
\0 •■■ / 

where the contains terms of 0(A 2 ) and higher. The system of equations (}4T?|) are the open- 
loop dynamics for an 2A^-dimensional integrable Hamiltonian system whose origin lies at the 
control target. The linear term of (J49|) is separated into non- interacting subspaces whose 
dynamics are those of a shear flow, as expected. This potentially leads to Takens-Bogdanov 
bifurcations of very high dimensionality. Knowing how the target's basin scales (after control 
is applied) is crucial for understanding the control of the higher dimensional systems. The 
high dimensionality makes an analysis which is similar to that done in Section HVI difficult. 
Hence this problem is still open to study. 



Acknowledgments 

The authors would like to thank the US Department of Energy's Office of Fusion Energy 
Sciences for supporting this work. We would also like to thank Lazar Friedland, Alfred 
Osborne, Allan Kaufman, Bill Cooke, and the nonlinear studies group at The College of 
William and Mary for helpful comments and suggestions. 



26 



APPENDIX A: THE TRANSFORMED CONTROL LAW 



Consider (J3J): 

z= JV z #(z) + e-(z (t)-z), (Al) 

where e = e#l + ejJ. We transform to a new set of coordinates, Z e M 2Ar , via a time 
dependent transformation on z = z(Z; i) such that Z(0; t) = zq(€). We first find Z = dZ/dt 
following an arbitrary orbit z(t) = z(Z(t);t). Define the Jacobian of the transformation to 
be: 

Uum§±, (A2) 

and note that M = M(Z;t). Further, we denote the Jacobian following the target orbit 
as Mo(t) = M(0;t). We also assume that the transformation is smooth and invertible (i.e. 
det(M) ^ for all Z and t). The time derivative of z becomes: 

dz k dz^dZ^ dzk 
dt ~ dZ t dt dt 1 

z = MZ + -^, (A3) 
at 

where summation over repeated indices is implied. Equation (jA3|) holds for any orbit. Note 
that since Z = is a fixed point, we have: 

dz . 

zo = ^l(Z=0;t)- (A4) 



The gradient transforms as: 



Therefore, 



jr = < A5 > 

J kl-K~ — Jkl-Z T77^- l At) J 

Noting that M~* = dZ m /dzi and substituting the above results into (|A1J) we get: 

Z = M" 1 JM- 1 V z ^(z(Z; *)) - M~ l 9z ^ + M -1 • e • (z (t) - z(Z; t)), (A7) 

where M denotes the transpose of M. 

The equation ()A7|) is true for a general coordinate transformation. In particular, we are 
interested in canonical transformations. In canonical transformations, MJM = J for all Z 
and we say that M is symplectic. Because the set of symplectic matrices form a group, the 
symplectic condition also holds for M -1 for any M in the symplectic group. We further note 
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that from the theory of canonical transformations 9], the M~ 1 dz/dt term can be re-cast in 
Hamiltonian form and the open-loop dynamics written as Z = JVzK(Z,t) for some new 
time dependent Hamiltonian, K. What interests us most is the form of the control terms 
(with control gain e) under the transformation. We find this by Taylor expanding z(Z; t) 
about the target, z , 

z(Z;t) = z (t)+M (t)-Z + O(Z 2 ), 
M(Z;t) = M (t) + O(Z), 

M" 1 = M -\t) + 0(Z). (A8) 

The control term then becomes: 

A/" 1 • e • (z (t) - z(Z; t)) =- Mq 1 ■ e ■ M • Z + 0(Z 2 ), 
M^(e R l + e I J)M = e R l + e I M^ JM , 

= enl + ejJMoMo, (A9) 

where we have used the symplectic condition to write Mq J = JM . 
If we define S (t) = M M , (JMJ) becomes: 

Z = JV Z K(Z; t)-e R l-Z- e T JS (t) ■ Z + 0(Z 2 ), (A10) 

as quoted in the text. 



APPENDIX B: DERIVATION OF THE ISLAND WIDTH FOR CONSERVATIVE 
CONTROL 

The typical scaling of the island width with purely conservative control can be most easily 
demonstrated by example. Consider a nonlinear one- dimensional Hamiltonian system with 
Hamiltonian: 

H = h 2 + h(I), (Bl) 

where h(I) contains terms of 0(I 3 ) and higher. In this system, the target oribit is (/ = 
0,0 = uJot). We add a general conservative perturbation, which is periodic and resonant 
with the target: 

K'{I,<f)) = ^I 2 -aeiCOs{(i>) + h{I), (B2) 
28 



the appearance of the minus sign in front of the cosine term ensures that the island opens at 
the target, as explained in the text. It is easy to verify that the fixed points for the system 
with Hamiltonian, K', are at (/ = 0,0 = mr) for n = 0, 1,2, . . .. Figure 121 illustrates the 
phase space for our controlled system (jB2|) . while Figure ^3 shows the open-loop dynamics 
for this system. The value of K' along the separatrix is given by its value at the saddle 
point, K'(0, — tt) = aej. Therefore, along the separatix 

-I 2 — aej cos(0) = aei . (B3) 

Solving (|B3|) for Is(<f>), the action Is{4>) is at a maximum when = 0, therefore it is easy 
to solve for the width of the island, A « 0(y/aej). 

APPENDIX C: HIGHER ORDER ESTIMATES OF a c 

In this Appendix, we will examine an approximate equation for the stable manifold of the 
saddle in order to obtain an error estimate for (|2*Hj) and for (jD9|) . This will be done using a 
Taylor approximation for the stable manifold of the saddle. In Section HVl we mentioned that 
the triangle relation is a first order Taylor series approximation for the stable manifold. The 
first order Taylor approximation is, of course, a striaght line. As can be seen from Figure |Hl 
the stable manifold has a curvature to it which requires higher order terms in the Taylor 
approximation for a more accurate measurement of a c . We will see that while the triangle 
relation doesn't not take into account this curvature, it still yields the correct leading order 
dependence in e R for a c . For simplicity, we will consider only the purely dissipative case 
(e, = 0). 

1. Approximation of the Stable Manifold of (|24|) 

Recall that our generic two-dimensional dynamics about the target are: 

\r ) \ o -t R ) \r ) \b& + b&r) 

Finding an approximate equation for the stable manifold of the saddle is the same as finding 
an approximate equation for /'($) near the saddle point. Hence, we are interested in solving 
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the equation, 

F($ ' /) = d$- - eR $ + xr ' (C2) 

for We can think of J') as a function of the angle, $, parameterized by the 

action The stable manifold will be a curve, which passes through the saddle point 

in the direction of the saddle's stable eigenvector. 

Next, we approximate by a quadratic polynomial (Taylor series to second order): 

/'($) « ai + a 2 <£> + a 3 $ 2 . (C3) 



We insert the approximation into the left hand side of (|C2J) and Taylor expand the right 
hand side of (jC2|) about the saddle: 

By equating terms of similar powers of $ gives: 

(2A6i + e R b 2 )e R 



a 2 
a 3 



(A61 + e R 6 2 )A 
61 



2e fl 



(C5) 



The term a% is found by observing that: 

r s (Q s ) = on + a 2 $ 5 + a 3 *|, (C6) 

this gives: 

26^ + 46 2 e fi 

1 (&iA + e fl 6 2 )A 4(6 1 A + e il 6 2 ' 1 ' 

We can approximate a c by finding where the stable manifold intersects the $-axis (see 
Figure ITTI below, where locally the x coordinate is analagous to I' and y is locally analagous 
to $). Hence: 

= 24 7A&! + Ab 2 e R 
ac ~ ai (M + e R b 2 )X 4(&]A + e fl fe 2 ' 1 J 

We see that ()C8|) is written in the form: a c w ai°^g(e R ), where ere "* is the noise threshold 

given by the triangle relation. Immediately, we see that the triangle relation gives the correct 

parameter dependence (in e R ). The multiplicative constant not present in the triangle 

relation results is due to the curvature of the stable manifold and does not change the 
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leading order parameter dependence. For a clarification of this, see Figure E] below. We 
can systematically improve this estimate by including more terms in the Taylor expansion 
(|C3J) . Next, we will compute a c for the NLS problem. 



2. Manifold Approximation for NLS 

We will use the equations developed in Appendix \D\ to derive an approximation of the 
saddle's stable manifold. We begin with the equations: 

x = e R (a -x) + 2y(x 2 + y 2 - a 2 ), (C9) 
y = -e R y-2x(x 2 + y 2 -a 2 ) 1 (CIO) 

where (jC9|) and (jC10|) describes the time evolution of the real (x) and imaginary (y) part of 
q in (|33|). The location of the saddle in this coordinate system is: 

We are interested in finding a curve x(y) which approximates the stable manifold. As in the 
eariler case, we study the ratio: 

ev„.. „\ - dx _ e ^( a ~ x ) + 2 y( x2 + y 2 ~ q2 ) 

ny,X) ~dy~ -e R y-2x(x* + yi-ai) ' [ ^ ' 

We will approximate the stable manifold with a quadratic polynomial, 

x(y) w ai + a 2 y + a 3 y 2 . (C13) 

The coefficients c 2 and C3 can be using the method outlined above. We can see from Figure |H1 
that a c lies approximately along the x-axis. Therefore, the most important term in the 
approximation will be c\. We find C\ by evaluating ()C13|) at the saddle point: 

ci«a- 7^4 + 0(4) + ••■• (C14) 
Because we approximate a c as lying along the x-axis, a c ~ a — Cx. 

«c*^e R + 0(e R ) + .... (C15) 

We see that just like in the generic case, we have a multiplicative correction to the leading 
order term due to the curvature of the stable manifold (see Figure |TTJ). Figure [TTJ shows 
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FIG. 11: The state space of (IC9|) . (|C10|) near the target. The straight line is the approximation of 
the stable manifold used by the triangle relation. 

the state space of (|C9|) . (jC10|) near the target. The curve W s is the stable manifold of the 
saddle, S, and W u is the unstable manifold which connects the saddle to the target, O. 
The straight line is the approximation of the stable manifold used by the triangle relation, 
a first order Taylor approximation of W s . The second order Taylor approximation of W s 
is indistinguisable from W s at this scale. We see immediately that (jD9|) gives the correct 
scaling (as shown in Figure ITUj) for a c , but (jlo]) is off by a constant. This can be seen by 
noting the scale of the x-axis in Figure ^2 In fact, (jD9|) is slightly less than the true value of 
a c (which is where W s intersects the x-axis) mainly due to the curvature of W s . While this 
plot is generated with a specific value of e# = 0.1, the shape of the manifolds is characteristic 
of this unfolding of the Takens-Bogdanov bifurcation. 

APPENDIX D: FINDING a c USING THE REAL AND IMAGINARY PARTS OF 
(1551) 

In this section, we will present the equations and the analysis used to develop the numer- 
ical results of Figure In Section we chose to use action-angle coordinates because it 
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mirrored the analysis done in Section HVl However, the more familiar coordinates of Re(q) 
and Im(q) provide more insight into the physics of the problem. The a c used in Figure El 
is the one computed below. We will see that both (|35Jl and (jD9J) have the same scaling in 

We begin by subsituting q{t) = p(t)e i(2a2 *~^ (f)) into flUHJ): 

p = e R (a cos(ip) — p) — e/a sin(-?/>), (Dl) 
pip = 2p(a 2 — p 2 ) — e/(a cos(^) — p) — e R a sin(^). (D2) 

These equations now describe the system in a frame rotating with the target solution. 
However, note that the target is not at the origin, it is at (p = a,ip = 0). Next, we 
transform to cartesian coordinates: x = pcos(ip), y = psinf^): 

x = e R (a - x) - eiy + 2y(x 2 + y 2 - a 2 ), (D3) 
V = ~e R y + e 7 (a - x) - 2x{x 2 + y 2 - a 2 ). (D4) 



The equations ()D3|l and ()D4|l are the equations from which we will derive a c . The target is 
located at (x = a,y = 0). For the purposes of Figure E3 we will be only interested in the 
purely dissipative case. Hence, we will set ej = 0. Next, we will compute the normal form 
about the target to second order (including the e R terms) with y = Pi and x = a + j3 2 '- 

fix \ I -e R Aa 2 W fa \ ( -2a{3 2 



P2 J \ -e R ) \ fa J \ Aap^ 2 
We can solve for the location of the saddle using (jD5|) : 



+ .... (D5) 



Next, we linearize ()D5|) about the saddle, P\ = Pis + ®\-> Pi — Pis + a 2- 



di \ / — 2e R 4a 2 \ / oil 



3c 



2 




+ .... (D7) 



«2 / \ 8# / \ Q 2 

The angle, 9, between the eigevectors of the linear part of (jD7|) can be shown to be: 



Finally, using the triangle relation, a c = PisO, we find: 
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where the error terms have been computed in Appendix 
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